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Abstract 


We  consider  a regular  Markov  process  with  continuous  parameter,  countable 
state  space,  and  stationary  transition  probabilities,  over  which  we  define  a 
class  of  traffic  processes.  The  feasibility  that  multiple  traffic  processes 
constitute  mutually  independent  Poisson  processes  is  investigated  in  some  detail. 

We  show  that  a variety  of  independence  conditions  on  a traffic  process 
and  the  underlying  Markov  process  are  equivalent  or  sufficient  to  ensure  Poisson 
related  properties;  these  conditions  include  independent  increments,  renewal, 
weak  pointwise  independence,  and  pointwise  independence.  Two  computational 
criteria  for  Poisson  traffic  are  developed:  a necessary  condition  in  terms  of 
weak  pointwise  independence,  and  a sufficient  condition  in  terms  of  pointwise 
independence.  The  utility  of  these  criteria  is  demonstrated  by  sample  applica- 
tions to  queue ing-theoretic  models. 

It  follows  that,  for  the  class  of  traffic  processes  as  per  this  paper  in 
queueing-theoretic  context,  Muntz's  M =»  M property,  Gelenbe  and  Muntz's 
notion  of  completeness,  and  Kelly's  notion  of  quasi-reversibility  are  essentially 
equivalent  to  pointwise  independence  of  traffic  and  state.  The  latter  concept, 
however,  is  the  most  general  one.  The  relevance  of  the  theory  developed  to 
queueing  network  decomposition  is  also  pointed  out. 


□ □ 


1 

1 . Introduction 

This  paper  has  grown  out  of  previous  work  on  traffic  in  certain  queueing 
networks  ([4],  [19],  [20])  whose  state  process  is  a discrete  state  Markov 

process.  The  paper  generalizes  several  aspects  of  the  discussion  and  results 
in  the  papers  alluded  to  above.  In  particular,  a general  notion  of  a traffic 
process  over  a discrete  state  Markov  process  will  be  defined  and  the  feasibility 
of  it  being  a Poisson  process  will  be  investigated.  We  shall  also  exemplify  the 
utility  of  the  results  by  applying  them  to  a number  of  queueing  models. 

In  the  way  of  motivation,  we  point  out  that  traffic  processes  in  networks 
with  flow  characteristics  (e.g.,  queueing  networks,  communication  networks, 
machine  repair  shops,  etc.)  are  an  important  operating  characteristic  of  such 
models.  They  are  also  of  major  importance  to  the  study  of  valid  decompositions 
of  such  networks.  It  is  common  to  postulate,  in  such  models,  that  the  incoming 
traffic  is  a Poisson  process,  a fact  that  often  renders  a mathematical  analysis 
tractable;  it  is  also  based  on  many  real-life  empirical  data.  If,  in  addition, 
one  may  validly  assume  that  traffic  flows  within  the  network  are  also  Poisson 
processes,  then  this  could  give  rise  to  decompositions  of  the  original  network 
such  that  each  component  subnetwork  may  be  validly  studied  in  isolation  ([4],  [20]). 

The  treatment  of  traffic  processes  in  this  paper  will,  however,  be  more 
general--at  the  level  of  Markov  processes. 
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. Traffic  Processes  over  a Discrete  State  Markov  Process 


Throughout  the  paper,  ;C(t)}  a will  designate  a right-continuous  Markov 
process  with  parameter  set  [a,  “)  for  some  real  a,  and  a countable  state  set  7. 

We  assume  ;C(t)]  to  have  standard  and  stationary  transition  probabilities, 
so  that  the  associated  infinitesimal  generator  matrix  Q is  time  homogenous;  its 
transition  rate  elements  are  denoted  q (y , 5),  y,  5 - 7.  We  shall  further  assume 
that  the  q(v)  = ^ q(v,  5)  are  bounded  as  y ranges  over  T.  Thus  the  process 

i€r-tv} 

[C(t)}tia  is  regular  in  the  sense  of  Cinlar  [8]  p.  251  and  our  assumptions  on 

imply  that  the  associated  Forward  and  Backward  Kolmogarov  Equations  have 
unique  and  identical  solutions  for  the  transition  probabilities  ([12]  p.  475). 

Denoting  cc(y)  A P[C(t)  “ v]  and  premultiplying  the  matrix  form  of  the 
Forward  Equations  (cf . [11]  pp.  240-241)  by  a row  vector  initial  condition  with 
components  ca(v)  yields  a system  of  equations  in  the  absolute  state  probabilities 


(Y)  * £ c (?)q(?,  Y)  - c 

C ?€My)  C C 


(y ) q (y ) > t 2 a,  Y € r. 


(2.1) 


We  shall  say  that  equilibrium  prevails  if  [C(t)Jtia  in  steady  state; 

equivalently,  in  equilibrium,  ct(v)  = 0,  t 2 a,  for  all  v € 7. 

2 

Next,  let  3 Cf  - r(v,  y):  Y ‘ 7)  >>e  an  arbitrary  set  of  pairs  of  distinct 

states.  To  avoid  trivialities  we  shall  always  assume  that  9 i.  For  each  y € 7, 

9 gives  rise  to  the  following  sets  9(v,  •)  ■ {fi : (v,  5)  t 9]  and 

3(* . v)  ^ [3  : (3  , v)  € 31 . 

Consider  the  sequence  of  epoches  [T  } »q  where 

f a,  if  n ■ 0 
T - { 

n [ inf  ft:  t > T . , (C  (t-) , C (t ) ) £8},  if  n>0 
induced  by  9 . 

Thus,  T^  is  the  epoch  of  the  n-th  occurrence  of  a jump  in  fC(t)}t  from 


■C. 
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some  y € T to  some  h € P such  that  (v , 6)  € 9.  We  adopt  here  the  view  that  certain 
state  transitions  in  the  underlying  {C(t))  are  interpreted  as  traffic  due  to 
entities  (customers,  messages,  etc.)  moving  about  in  the  system. 

QB 

Instead  of  studying  the  traffic  point  process  "Tn)n-o>  one  equiva- 

e •>  GO 

lently  elect  to  study  the  traffic  interval  process  '.T  t " Tn*n-o»  or  equiva- 
lently again  the  traffic  counting  process  [K(t)}  defined  by 

{0,  if  t ■ a 

n,  if  TBBt<Tn+1. 

The  state  space  of  (K(t)}  is  N U [0}  where  N is  the  set  of  natural  numbers. 

In  this  paper,  we  shall  adopt  the  following  terminology. 

Definition  2.1 

A traffic  process  over  {C(t)1...  Is  a process  fK(t)K_.  induced  by  some 

2 

9 C T " ( (y  > v):  v 6 r]  as  described  above.  The  inducing  9 will  henceforth  be 
referred  to  as  a traffic  set. 

The  particular  choice  of  the  representation  of  a traffic  process  is  a mere 
technical  convenience  serving  the  purposes  of  this  paper.  It  is  simply  due  to 
the  fact  that  a Poisson  process  can  be  represented  as  a counting  process  whose 
state  probabilities  satisfy  a simple  system  of  birth  equations. 

What  can  be  said  about  the  Joint  process  {(C(t),  K(c))}taa’  First,  we  show 
(cf.  [4],  Theorem  1) 

Lemma  2 . 1 

The  Joint  process  !’(C(t),  K(t))}  is  a conservative  Markov  process  with 


bounded  transition  rates. 
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Proof 


The  lumps  of  'K(t))  are  contained  in  those  of  CC(t)l.  . Therefore,  the 
' c^a  c^a 

Joint  process  is  conservative,  since  r.C(t)}  is.  Clearly,  for  every  s < u, 
K(u)  - K(s)  is  measurable  with  respect  to  the  c-algebra  <y(C(t):  s < t s u} 


generated  by  rC(t)} 


3<tSll 


Let  a < t^  < t^  < ...  < t^  < u be  a partition  of  the 


interval  [a,  u].  Then,  for  any  Vj  t f,  n^  c N 'J  {0 } , 1 s J s r,  and  by  the 
Markov  property  of  [C(t)} 


P[C(u)  - v.  K(u)  - n(  n (C(t.)  - v.,  K(t.)  - a,}] 

4-1  J J J J 


L 

- P[C(u)  - v,  K(u)  - K(tr)  ■ n - nr|  P^Cc(tj)  - Vy  K(t j ) - n^] 

- P (C (u)  - v,  K(u)  - K(tr)  - n - nr|C(tr)  - Yr.  Kt  - nr] 

- P [C (u)  - v,  K(u)  - a|C(tr)  - v , Kc  - nr] 

r 

which  verifies  the  requisite  Markov  property  of  the  process  f(C(t),  K(t))}t2a* 
Finally,  boundedness  of  the  transition  rates  of  the  Joint  process  follows 
from  the  fact  that  they  have  the  form 


!q  (y , 5 ) , if  (v  , 5 ) € 3 and  0 £ i * J - 1 

q(v,  4),  if  (V,  J)  I 3 and  0 s i - J 

0,  otherwise 


(2.2) 


Denoting  Pc(v,  n)  ^ P[C(t)  ■ y,  K(t)  * n]  and  with  the  aid  of  (2.2),  we  can 
now  derive  the  equations  in  the  absolute  state  probabilities  for  f(C(t),  K(c))}taa» 
analogously  to  the  ones  previously  derived  for  [C(t)}  . 


JL  P 

3t  t 


P (y,  n)  - Z P (5,  n)q (5,  y)  + Z pt(S.  n - l)q(§,  y) 

^ Iff  . . \l  if  ^ t _ / \ t 


?&<-,Y>U{y} 


S69(-,y) 


• pc(v,  a)q(v), 


t i a,  (y,  n)  € r x (N  'J  [0}) 


(2.3) 
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The  initial  conditions  are 


Pa(v.  k)  “ 

Cl 


c (v ) , if  k ■ 0 
a v ’ 


0,  otherwise 


since  K(a)  “0  almost  surely. 

Eq.  (2.3)  can  be  equivalently  written  as 

P„(v,  a)  - 21  Pr(5,  “)<!(?>  y)  - pP  (v  > n)q(v) 

-c  c 5€r-{v}  c c 


(2.4) 


21  (P  (n.  n - 1)  * Pt(^,  n))q(n,  y)  , 

r'€9(,»v) 

t a a,  (y,  n)  £ f x (N  U [0}),  (2.5) 


by  adding  and  subtracting  — P (rt,  n)q(n,  v)  from  Eq.  (2.3). 

©(  * ,y) 

Finally,  denoting  kt(n)  * P[K(t)  ■ n]  and  summing  Eq.  (2.5)  over  y € T 
gives  us 


Mn>  " u - (M”!.  n - 1)  - P (r,  n))q(r| 

-C  C v€r  n£9(.,Y)  C 


y). 

tia,  n € N'J  [0] . 


(2.6) 


To  interchange  summation  and  differentiation  in  the  above  we  have  used  the  fact 
chat  the  ?c(y,  n)  have  derivatives  of  every  order  in  t,  and  that  every  countable 
sum  of  Che  Pc(v.  a)  over  a subset  of  r X (N  U {0))  is  uniformly  convergent  on 
each  compact  time  interval  of  la,  ®) . This  fact  will  henceforth  justify  all 
termwise  operations  on  sums  of  the  Pc(y,  n)  such  as  termwise  integration, 
differentiation,  etc.  (124],  1.1,  1.7). 

Throughout  the  paper  we  denote  M(t)  ^ E (K(t) ] . To  avoid  trivialities  we 
shall,  henceforth,  restrict  the  discussion  to  substantive  traffic  processes  in 
the  following  sense  : 


Definition  2.2 


A traffic  process  is  nontrivial  if  M(t)  * 0 > otherwise  it  is  trivial. 


We  now  show 
Theorem  2 . 1 

t 

M(t)  - £ £ qOi,  v)  cT(r)dT,  t 2 a. 

v€r  *Y=0(*,y)  a 


Proof 

For  every  fixed  J € N sum  (2.6)  over  n 2 ) ; then  integrate  both  sides  of 
the  resultant  sum  thus  obtaining 

t 

PlK(t)  2 J]  - £ £ qOi,  y)  ^ PT(n,  j - l)dT,  t 2 a. 

v€r  *^0(*.v)  ^ 

Eq.  (2.7)  now  follows  by  summing  the  above  over  ) € N , since  is  a 

nonnegative  integer-valued  random  variable. 

Corollary  2.1 

M(t)  a \c,  t 2 0,  for  some  \ 2 0 iff 

£ £ c (r)q(ru  y)  * const.,  t 2 a. 

v€r  ’'631  ( • ,y  ) 

In  particular , M(t)  * It,  t » a,  in  equilibrium. 


In  this  section  we  shall  give  a number  of  simple  characterizations  of 
Poisson  related  traffic  processes  over  a Markovian  process.  We  shall  see  that 
only  a subset  of  the  ordinary  Poisson  axioms  will  here  suffice. 

To  simplify  notation  we  shall  henceforth  denote 

m(t)  - Z T.  c On)q(r|,  y)  ■ M(t)  and  m(t,  v)  * £ c (n)q(n,  y). 

v€f  *'63(*,y)  '"60(#,y) 

Intuitively,  m(t)  is  the  total  rate  of  expected  traffic  count,  while  m(t,  v)  is 
the  rate  of  expected  traffic  count  due  to  transitions  into  state  v.  Observe  that 
m(t)  ■ H m ( t , v)  and  that  in  equilibrium  both  m(t)  and  m(t,  v)  are  independent  of  t 

v€r 

The  first  theorem  characterizes  an  arbitrary  Poisson  process  over  ^CCt)1- 

• Oa 

Theorem  3 . 1 

[K(t)}caa  is  a Poisson  process  iff  fK(t)}ta>  h*s  independent  increments. 

Proof 

A Poisson  process  has  independent  increments  by  definition.  Conversely,  the 
only  counting  process  with  unit  Jumps  and  continuous  mean  function  is  the  Poisson 
process  (see  e.g.,  Cinlar  [8]  Ch.  4). 

The  second  theorem  characterizes  a time  homogenous  Poisson  process  over 

Theorem  3 .2 

fRCt)}  is  a time  homogenous  Poisson  process  iff  the  following  conditions 

L 2d 

hold: 

_ 00 

i)  [Tn}amQ  is  a renewal  process 


ii)  m(t)  s m(a) , t 2 a. 
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(=»)  If  rK(c)}  Is  a time  homogenous  Poisson  process  Chen  ic  is  well-known 


a 

chac  'I  } . is  a renewal  process.  Furthermore,  che  rate  function  of  "K(t)l  is 

n'n“0  r L • c«ta 


m(t)  a m(a)  as  required,  due  to  Corollary  2.1. 


(=)  Conversely,  suppose  that  i)  and  ii)  hold.  Since  the  renewal  function 


1(c)  of  'T  } - is  R(t)  ■ M(c)  » m(r)dr  » m(a)t,  it  follows  chat  fK(t)}„ 


must  be  a time  homogenous  Poisson  process,  as  R(t)  determines  a renewal  process. 


Coro llarv  3 . 1 


In  equilibrium,  the  renewal  process  property  of  . is  equivalent  to 

che  Poisson  process  property  of  [K(t)} 


The  preceding  characterizations  give  us  some  information  as  regards  non- 


Poisson  traffic  processes,  by  way  of  elimination. 


Corollary  3.2 


Suppose  lK(c)}t2a  not  a Poisson  process.  Then  [K(t)]t;aa  does  not  have 


. 00 

independent  increments,  and,  in  equilibrium,  the  respective  point  process  [TnJn=Q 


is  not  even  a renewal  process  (though  it  may  be  a delayed  renewal  process). 


for 


■+  • Multiple  Traffic  Processes  over  a Discrete  State  Markov  Process 

Lee  K.  (t)  ) K ( t ) } be  traffic  processes  over  ’C(t)-  , for 

' 1 tia  I C2a  r tea 

some  fixed  but  arbitrary  L - M . For  tbe  i-ch  traffic  process  above,  the  asso- 
ciated entities  are  denoted  9^  for  its  traffic  set,  M. (t)  for  its  mean  function, 

Jt£  ^ (n)  ■ P[K^(t)  “ n],  etc.;  in  general,  we  append  the  appropriate  index  to 
such  previously  defined  symbols.  To  simplify  notation  we  shall  denote  in  the 

sequel  K(t)  a (K^(t) K^(t))  to  be  the  vector  traffic  process, 

\ 

n 54  (n^,  ...,  n^)  to  be  a vector  with  nonnegative  integer  components,  and 

k^Cn)  3 P[K^(t)  “ n^ , ...,  K^(t)  = n ].  Lemma  2.1  still  holds  mutatis  mutandis 

for  Che  joint  process  *.(C(t);  K.  (t) , ...,  K (t))}  ; the  new  transition  rates  are 

1 Z C^cl 


q((v,  i),  (i,  j)) 


q (y  , 8 ) , if  i = j - T,  Y { (v  , 5 )e  . 

i=*l  1 1 


0,  otherwise 


(v,  i),  (4,  j)  6 f X ‘M  J r0})i  in  the  above  is  the  characteristic  function 


Xt(v,  4) 


1,  if  (v,  5)  € 3. 
0,  otherwise 


and  e is  the  n-dimens ional  unit  vector  with  1 in  the  i-th  coordinate. 

The  counterpart  of  Eq.  (2.5)  for  the  joint  process 
[C(t>,  KjCt) K (t) ) } is 


P„(v.  a) 


'L  Pt(?,  n)q(|,  v)  - Pc(v,  n)q (y ) 

r-Tvi 


?er-fv} 


Pt(",  n - E xt(r|,  v)e.)  - P (r>,  n))q(-,  v), 
C 1,1  1 1 C 


U 3t(*,v) 

i-1  1 


t a a,  (v,  n)  € T x (N  J {O')' 
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For  reasons  that  will  become  apparent  later  on,  we  shall  restrict  the 
discussion  to  traffic  processes  which  are  disjoint  in  the  following  sense. 

Def inition  4 ■ 1 

rk.  /..-.i,  f k (t)l  are  said  to  be  disjoint  traffic  processes  if 

'■*V  ;jtza’  l Jt2a  

their  associated  traffic  sets  3^ are  disjoint  sets. 


For  disjoint  traffic  processes,  Eq.  (4.2)  reduces  to 


-f-  P (V,  n)  - T P„(§.  ti)q(5,  7)  - Pc(v,  n)q(v) 
-t  c 1 


i»l  3.  ( • ,v) 


(P  (->,  n - ei)  - P^r,  a) ) q (-? , v), 


t 2 a,  (y,  n)  € T X (N  'J  f0]) 


(4.3) 


The  initial  condition  becomes 


c.  (v)  , if  n.  " 0 for  all  1 £ i & l 
a i 


P (v,  n)  - 

L 0,  otherwise. 


(4.4) 


The  counterpart  of  Eq.  (2.6)  is  obtained  by  summing  Eq.  (4.3)  over  y € 


thus  yielding 


-S-  k (n)  - S E I (Pr(n,  n - e ) - P On,  n))q(n,  y), 

2t  c i-ivernes^-.Y)  c 

t 2 a,  n 6 (N  U r0})2. 


(4.5) 


b . Multiple  Disjoint  Poisson  Traffic  Processes 


In  this  section  we  investigate  the  possibility  that  disjoint  multiple  traffic 
processes  ....  '.K,(t)}t  'iave  Poisson  related  properties.  In  par- 

ticular, the  upcoming  discussion  applies  to  single  traffic  processes  as  the  special 
case  l ■ 1. 


Definition  5.i 

Ihe  processes  JClt)]^,  £Kl(t)}t2a -MO^tia  are  said  to  be  polntwlse 

independent  if  for  every  t 2 a the  random  variables  Ctt),  K,  it) K (t)  are 

1 t 

mutually  independent.  rhe  processes  above  are  said  to  be  weakly  pointwlse  inde- 
pendent if  for  every  t 2 a and  every  (n. n,)  c (N  U [O’})11, 

1 c 


-«  — — P^On,  n. n,)q(n,  y) 

1-1  n€?  r*9t(-(Y)  4 


i 

v v 

i-i  vir 


^i< 


>v ) 


ctC 


i 

i)l"jTk 

J-l 


(J) 


(5.1) 


Since  pointwise  independence  is  of  central  interest  here,  the  disjointness  assump- 
tion is  made  so  as  not  to  preclude  it  a priori. 

We  begin,  however,  with  a characterization  of  weak  pointwise  independence. 

rheorem  5 . 1 

K^(t),  (t)  have  mutually  independent  Poisson  distributions  for  every 

t 2 a iff  [C(t)  ;t2a»  3re  weak^)r  P°lntwise  indepen- 

dent processes. 

Proof 

(=»)  Suppose  the  K^(t),  1 s i s £,  are  distributed  as  mutually  independent 
Poissons.  rhen  the  generating  function  of  K(t)  is 
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(5.2) 


-Vyr 


exp(  H M 

i-L 


t (t)  (.y  - 1) ) , t 2 


L'  » 


whence 


• . . . y ) L m . ( t) (y  . 
“ 1-1  L 1 


1 ) , t 2 a , : y 4l,  ui-,;, 

(5.3) 


On  equating  coefficients  in  (5.3)  we  obtain 


* kt(n) 


1*1 

i 


(kt  (n  - e ^ ) - k.^  (n)  )m^  ( t) 


“ ( ! 1 ‘VJ>UJ  - 5j,i) ' 1 ! 

i-l  J-l  J J ’ j-l 


1 k^\n.))  M c lr)q(*',  v) 

J Ytr  (•  ,v ) 


(5.4) 


t i a,  n - In. n.)  c (N  'J  ■' 0 } ) 


where  » is  Kronecker's  delta. 

j.  i 

Eq.  (5.1)  now  follows  by  equating  the  right  side  of  Eq.  (5.4)  to  the  right 

side  of  Eq . (4.5),  via  a straightforward  multiple  induction  on  n • (n^,  ...,  nf). 

(3)  Assume  that  Eq . (5.1)  holds.  Substituting  (5.1)  into  (4.5)  and 

rearranging  terms  in  the  resultant  equation  yields  Eq.  (5.4).  Ihe  latter  is 

equivalent  to  Eq.  (5.3)  whose  unique  solution  is  given  bv  Eq.  (5.2),  since  the 

initial  condition  is  (y. y ) 3 1,  !y  j si,  1 s i S £,  by  virtue  of  (4.4). 

a L Z 1 i 

Consequently,  k^ln)  corresponds  to  l Poisson-distributed  processes  with 
respective  rate  functions  m^(t);  moreover,  the  K^(t)  are  mutuaLly  independent  for 
every  t 2 a. 


Corollary  5.1 

If  :C(t)]„  is  in  equilibrium  and  fK(t)}  Ls  a singleton  ( r - 1)  Poisson 
tia  tia 

traffic  process  over  it,  then  necessarily 

. r 

s *•  r+1 

— ~“~1  PfA*1,  0)q(n.  y)  * (-1)  (n(a))  exp(-m(a)t),  r c N , .'O', 

vtf  3(  * , v ) 3t 
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Next  we  characterize  pointwise  independence  of  traffic  and  state. 


Theorem  5 .2 

'C(t)  • • *K  (t)’  ' K (t)'  are  pointwise  independent  processes 

• t2a  1 -taa  l 'taa 


iff 


Z m ( t , v ) - c (v ) m . (t ) , t 2 a , for  every  v € T 

i-1  1 i-1 


(5.5) 


Proof 


(=»)  Suppose  pointwise  independence  holds.  Eq.  (4.3)  is  equivalent  to  the 
generating  function  equation 


t^lct(v)«t(y1,  ....  yi}]  - _ Z ct.(?)c?t(y1,  ...,  y£)q(5.  v) 

§fer-[v} 

- ct(v)t?t(yl,  ....  y^)q(v)  (5.6) 

l 

+ Z Z ct(r)cpc(y1,  ....  y^)  (y£  - Dq(rj,  v), 


i=l  '7€0i(- . v ) 


t 2 a,  |y^ j si,  1 S i s l, 


l 


where  ® (y.  , ...,  y ) - exp (lM,(t)(y.  - D)  is  the  generating  function  of  K(t) 
t 1 * i-1 

due  to  Theorem  5.1.  We  use  this  form  of  cp^(y^,  «...  y^)  in  differentiating  the 
left  side  of  (5.6)  which  after  some  manipulation  becomes 


^[ct(v)ot(yl,  ....  y4)J  ■ ®t(y1 yp^ct(v)  + Cc(v) •51mi(t) (yi  ‘ L))‘ 

Since  cs  (y  , ...,  y ) may  be  cancelled  on  both  sides  of  (5.6),  the  latter 

t 1 A 

reduces  to 


•ft  Cr  (v)  + c (y)  Z m (t)  (y  - 1)  - tr  c (v)  + Z m (t,  y)  (y  - 1) . 
3t  t c i*l  1 1 3t  c i-1  1 1 


(5.7) 


Eq . (5.5)  now  follows  from  che  above  by  equating  the  relevant  coefficients. 
(*)  Suppose  Eq . (5.5)  holds.  It  can  be  checked  directly  Chat 


f l 


i-1 


“i(t-Y>  l 


l 

rr 

i-1 


tn^  (t) 


(M. (t) ) J l 

exp(-M(t))  — j , if  Hn.(t)>0 

j-1  “j*  i-1  1 


’ nl ^ | 


(5.8) 


L 0,  otherwise 


solves  Eq.  (4.3)  and  is  consistent  with  the  initial  condition  (4.4).  An  easy 
proof  of  this  assertion  involves  the  transformation  of  (5.8)  into  the  appropriate 
c (y ) c.  (y , . ....  y.)  and  then  working  the  way  backwards  from  (5.7)  to  (5.6)  which 
is  equivalent  to  (4.3). 


Corollary  5.2 

a)  Cc(t)}taa,  [K1(t)}taa,  rKjiCt)}t2a  are  mutually  pointwise  independent 

iff  fC(t)}  and  [K.(t)}  , 1 £ i £ l,  are  pointwise  independent  in  pairs. 

b)  Eq.  (5.5)  holds  iff  for  every  1 £ i £ J, 

n>1(t,  y)  - c^(y )L^(t) , t 2 a,  y € I\ 

for  some  functions  Li(t)  depending  on  C only;  in  fact,  for  every  1 S i s 1, 
Li(t)  a mi(t),  necessarily. 

c)  Consequently,  in  equilibrium,  Eq.  (5.5)  holds  iff  for  every  Is  i £ £, 

m1(c,  y)  - c^y)^,  t 2 a,  y c T 

for  some  constants  L^;  in  fact,  - m^  for  every  1 £ i ^ l- 

Proof 

a)  Mutual  pointwise  independence  implies  pointwise  independence  in  pairs.  Con- 
versely, pointwise  independence  in  pairs  implies  for  every  1 £ i £ £, 
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ni(t,  v)  - cc(v)m1(C),  t 2 a,  v € 7. 

This  becomes  Eq . (5.5)  on  summing  both  sides  over  1 s i £ l. 

b)  If  Eq.  (5.5)  holds,  then  from  a)  the  condition  holds  for  L^(c)  = nr(t). 
Conversely,  by  summing  both  sides  of  m^t,  v)  * cc(v)L^(t)  over  y € ~ we 
deduce  L^(t)  * m^(t) ; summing  it  over  l s i s ; then  yields  Eq.  (5.5). 

c)  Follows  immediately  from  b)  and  from  the  time  stationarity  of  the  m^t,  y) 
and  mi(t). 

The  relation  of  Eq . (5.5)  and  Corollary  5.2  to  Muntz  [22  j , and  Gelenbe 
and  Muntz  [13]  should  be  noted.  A more  detailed  discussion  is  deferred,  however, 
until  Sec . 8. 

Before  proceeding  to  the  main  theorem  we  shall  now  prove  two  supporting 
lemmas.  The  first  one  is  a generalization  of  Corollary  1 in  [4]. 

Lemma  5 . 1 

rc(c)}  and  the  multiple  traffic  process  ^(t)]  are  pointwise  inde- 
pendent  iff  for  any  fixed  s a a,  •fC(t)}tig  and  [K(t)  - K(s))t2s  are  pointwise 
independent . 

Proof 

(•<*)  Follows  imnediately  by  taking  s * a. 

(=)  Since  fC(t)}  is  a ^r^ov  process,  it  follows  from  Lemma  2.1  that 
{ (C (t) , K(t)  - also  Markovian.  To  distinguish  between  {(C(t), 

and  r(C(t),  !C(t)  - K(s))V  we  denote  the  various  mathematical  entities  associated 
with  the  latter  by  appending  tildas  to  the  corresponding  ones  in  the  former. 

Thus,  Eq.  (4.3)  is  satisfied  by  pt(v»  a)  over  the  domain  t € [s , ■) , subject 
to  the  initial  condition  (4.4)  with  a ■ s.  Since  ct(y)  a ~t(y)  for  every  y € 7 
and  t 2 s,  it  also  follows  that  m^y , t)  ■ SuCv,  t)  and  rn^t)  » nr(t)  for  any 
t 2 s , 1 s i £ l and  v € I*. 

Now,  by  pointwise  independence  of  [C(t)]  and  £KCc) , Eq.  (5.5)  holds, 
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whence 

i 

22  m.  (c,  v)  3 ~c(v)  22  m^(t)  , C 2 s,  v € 7,  (5.9) 

i3l  1 i“l  l 

also  holds.  The  Lemma  now  follows  from  (5.9)  by  applying  Theorem  5.2  in  the  other 
direction . 

The  second  lemma  is  tantamount  to  Burke's  argument  in  [5].  (See  also, 

Theorem  3 in  (4 ]) . 

Lemma  5.2 

Suppose  that  *C(t)}caa  and  clle  ®uitiple  traffic  process  fK(t) }t^a  are  point- 
wise  independent.  Then,  for  every  fixed  t 2 a,  the  c-algebras  2,fK(t)  - K(s):  s £ t} 
and  j'C(u),  K(u)  - K(t) : u 2 t}  are  independent. 

Proof 

Let  A 6 a rC(u),  K(u)  - K(t) : u 2 t}  * sfC(u):  u a t].  Now,  from  Lemma  5.1, 
and  the  Markov  property  of  rC(t);„  , we  can  write  for  any  s £ t,  7 6 " and 
a € (N  U {0}/  , 

P (A,  C(t)  - v,  K(t)  - K(s)  3 a] 

- PL\|C(t)  - v,  K(t)  - K(s)  3 n]-P[C(t)  3 v.  K(t)  - K(s)  3 n] 
3 PlA  C (t)  3 v ] • P (C (t)  3 y]*P[K(t)  - K(s)  3 n] 

3 PlA,  C(t)  3 v ] • P [K(t)  - K(s)  3 n] 

whence  on  sumning  both  sides  above  over  v £ T, 

PlA,  K(t)  - K(s)  3 n]  3 P lA ] *P [K(t)  - K(s)  3 n]  (5.10) 


as  required. 
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Corollary  5.3 

If  [C(t)l  and  'K(t)}  are  pointwise  independent  processes,  then  by 
Lemma  5.2  each  fKj.(t)]  , Is  i s has  independent  increments;  consequently, 
each  is  a Poisson  process  by  combining  Theorem  5.1  and  Lenma  5.2. 


We  shall  now  proceed  to  show  a stronger  independence  result,  (cf . Theorem  4 
in  [4]). 


Theorem  5.3 

Suppose  rC(t)'v  and  the  multiple  traffic  process  [K(t)}  are  pointwise 
independent  processes.  Then  the  component  traffic  processes  {K^(t)j  , ... 

...,  'K  (t)V  are  mutually  independent  Poisson  processes. 

Proof 

In  view  of  Corollary  5.3  it  suffices  to  show  that  for  each  partition 
a “ cq  < ci  < c2  < •••  < cr  “ t of  an  arbitrary  interval  [a,  t ] , and  for  any 
choice  of  nonnegative  integers  n , 1 £ i £ i,  1 £ J £ r,  the  events 

Ei,J  ‘ - Kt(tj  - 1)  - ntj  ] . 1 * i si,  1 s J s r, 

are  mutually  independent.  The  proof  is  by  induction  on  r. 

If  r - 1,  then  the  E are  mutually  independent  by  pointwise  independence 

among  the  fK^(t)]t  , and  the  induction  base  is  established. 

Assume  now  that  the  Theorem  holds  for  r ■ p,  p 2 1,  and  show  it  for  r - p + 1. 

t P i 

Since  [ 0 PE^];:  <K(tp)  * KCs) : s £ tp]  and  (^E1>p+l)  € ct{K(u)  -K(tp):  u 2 


we  can  write  by  virtue  of  Eq.  (5.10), 


l p+1 

p[n  n e.  - 

i-l  J-l  1,J 


L p 

P[(  n HE 

i-l  J-l 


) n ( 


1 

P E 
i-l 


i,p+l 


)] 


i 

P[  0 

i-l  J 


"i>  J 


]-Pl 


L 

n 

i-l 


Et.p+i Ji 
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Finally,  applying  Che  induction  hypothesis  to  the  first  factor,  and 
Lenina  5.1  to  the  second  factor  yields 

l p+1  l P+1 


l p-i-i  l 2Zk 

'[  " n E ] - TT  HPIE  ] 
i-1  J-l  1,3  i-1  j-1  1,3 


which  establishes  the  induction  step. 


In  view  of  Theorem  5.3,  we  now  see  that  Theorem  5.2  provides  us  with  a 
computational  criterion  as  follows: 


6 . Non-Poisson  Traffic:  Atomic  Processes  and 


Queueing-Theoretic  Examples 


This  section  demonstrates  how  weak  pointwise  independence  may  be  used  to 
show  non-Poisson  traffic  by  violating  the  necessary  condition  in  Theorem  5.1  and 
Corollary  5.1.  Consider  the  class  of  traffic  processes  defined  by 

Definition  6.1 

^K(t)}t2fl  is  called  an  atomic  traffic  process  if  its  traffic  set  0 is  a 
singleton  pair  of  states. 

Atomic  traffic  processes  are  the  elementary  building  blocks  of  all  traffic 
processes,  since  every  traffic  process  is  a superposition  of  disjoint  traffic 
atoms.  We  shall  now  exemplify  the  utility  of  the  weak  pointwise  independence 
concept  vis-a-vis  atomic  traffic  processes. 

First,  however,  we  show  a more  general  result. 

Lemma  6 . 1 

Let  f K(t) } be  a nontrivial  traffic  process  such  that 

ted 


( u ®( • » ;))  n ( u 3(5,  •))  - i. 
?®r  ?€r 


(6.1) 


Then  rK(t))  is  not  a time  homogenous  Poisson  process;  moreover,  in  equilibrium 
't2£L 


it  is  not  a Poisson  process  altogether. 


Proof 


Setting  n - 0 and  letting  t -»  a+  in  Eq.  (2.5)  gives  us 


it  °> 


ca(v)  - ®(a>  y) . v € T 


If  r\  € S(*.  v)  for  some  y € I\  then  9(* , r,)  * 5 by  (6.1)  so  that  m(a,  -|) 


Hence 


■19- 


i 
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Now  assume  rK(t)]t2a  is  a Poisson  process.  By  weak  pointwise  independence 
of  fC(t)]  and  fK(t)]t2a  (see  Theorem  5.1) 

— ZI  P (r,  0)q(-'f  v)  ” lim  [m(t)  *exp (-M(t) ) ] 

v€rn€9(-,v)dt  t-*a+ 

- lim  lm(t)  *exp(-M(t))  • (-m(t))  + exp (-M(t) ) m(t) ] 
t-*a+  dt 

* m(a)  - (m(a))2.  (6.3) 


A comparison  of  (6.2)  and  (6.3)  gives  us  necessarily  m(a)  * 0.  But  if 
[K(t)}  is  time  homogenous,  then  m(t)  = 0 from  ii)  in  Theorem  3.2,  which  con- 
tradicts  the  nontriviality  of  rK(t)}  . Finally,  in  equilibrium,  (K(t)}  is 

necessarily  time  homogenous  from  Corollary  2.1,  whence  the  rest  of  the  Theorem 
follows . 

We  can  now  assert. 

Corollary  6.1 

None  of  the  nontrivial  atomic  traffic  processes,  over  fC(t)j  is  a time 
homogenous  Poisson  process.  Furthermore,  in  equilibrium,  none  is  a Poisson  process. 

Proof 

The  Corollary  follows  trivially  since  every  singleton  traffic  set 


9 “ r(a»  B)J  satisfies  Eq.  (6.1). 
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Thus , in  equilibrium,  we  have  the  intuitively  curious  situation  where  none 
of  the  nontrivial  traffic  atoms  is  a Poisson  process;  however,  an  arbitrary  super- 
position of  traffic  atoms  may  or  may  not  be  a Poisson  process.  In  fact,  examples 
of  both  cases  abound  in  the  queueing-theoretic  literature  (see  next  section). 

We  point  out  that  if  a superposition  of  point  processes  forms  a Poisson 
process,  then  either  all  superposed  components  are  independent  Poisson  processes 
or  none  is.  Most  superposition  results  are  variants  of  the  first  type  (see,  e.g. 
Cinlar  [9]).  What  we  have  just  shown  is  a nonvacuous  example  that  falls  within 
the  scope  of  the  second  type. 

To  further  illustrate  the  utility  of  Corollary  6 . 1 we  note  that  the  departure 
process  (exclusive  of  the  loss  stream)  from  an  M/M/1/0  queue  in  equilibrium  is 
not  a Poisson  process.  In  the  same  spirit  we  can  deduce  that  any  departure  stream 
of  customers  from  a Markovian  queueing  network,  such  that  departing  customers 
leave  behind  a prescribed  network  state,  cannot  be  a Poisson  process  in  equilibrium. 

An  important  class  of  conjectured  non- Poisson  traffic  in  queueing  networks 
consists  in  most  traffic  on  arcs  having  direct  or  indirect  feedback  ([6];  [19], 
Conjecture  5.1).  Intuitively,  a recycling  of  customers  takes  place  which  deprives 
the  traffic  of  independent  increments.  Burke  [7]  proves  directly  the  non-Poisson 
conjecture  for  the  total  input  into  an  equilibrium  M/M/l  queue  with  feedback;  an 
extension  of  this  result  to  Jackson  queueing  networks  (see  Example  7.1)  with 
single  server  nodes  appears  in  Melamed  [21],  The  latter  is  based  on  Corollary 
5.1.  The  non-Poisson  conjecture  bears,  in  particular,  on  all  traffic  in  closed 
queueing  networks  such  as  the  ones  in  Gordon  and  Newell  [14]. 


w 


In  this  section  we  demonstrate  how  to  apply  pointwise  independence  to 
certain  traffic  processes  in  a number  of  queueing  networks  whose  discrete 
state  is  represented  by  a Markov  process.  These  applications  utilize  the 
computational  criterion  of  Theorem  5.2  as  set  forth  in  Corollary  5.2. 

Examp le  7.1:  Jackson  queueing  networks  (see  Jackson  [15]). 

A Jackson  network  consists  of  J service  stations  with  infinite  line 
capacities.  Each  station  J houses  s ^ parallel  independent  exponential  servers 
with  respective  rates  c j • Exogenous  customers  arrive  at  the  stations  according 
to  independent  Poisson  processes  with  respective  rates  . On  service  completion 
at  station  j a customer  is  routed  to  station  k,  0 s k s J,  with  probability  p 
(a  routing  to  k * 0 designates  leaving  the  network  altogether).  All  arrival, 
service,  and  routing  processes  are  mutually  independent. 

The  vector  valued  process  of  the  J line  sizes  is  a Markov  process  with 
state  space  r m [y  * (n^,  ...,  n^):  n^  € N U [0}].  Next,  suppose  the  equations 


Ej  '"J  * lS-<SJ' 


(7.1) 


have  a nonnegative  solution  in  the  5^,  1 4 ] s J.  This  is  always  the  case  when 
the  network  is  open  in  the  sense  that  it  is  possible  to  leave  the  network  from 
every  node  through  some  finite  sequence  of  routings  (see  [20],  Ch.  4). 

A 6 1 

Suppose  the  network  is  open  such  that  p * 1-<  1,  1 s ] s j.  Then  the 

J Vj 

J 

state  equilibrium  distribution  is  c (n. , ...,  nT)  s i ' c (n  ) where 

J j-1  C j 
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be  che  equilibrium  traffic  process  of  customers  that  leave 


the  network  from  station  j.  Thus 


we  compute  for  any  v 


min  i , s 


min'  n 


Hence,  part  c)  of  Corollary  5.2  holds  for  = “jPjO’ 

It  now  follows  from  Corollary  5.4  that  the  [K.(t)] 


mutually  independent  Poisson  processes  with  respective  rates  J.p 


We  point  out  that  this  result  includes  as  a special  case  the  well-known 


result  by  P.  J.  Burke  [5]  that  the  equilibrium  departure  process  from  a M/M/s 


queue  is  a Poisson  process  with  the  same  rate  as  the  arrival  process;  this 


result  was  arrived  at  by  examining  the  interdeparture  intervals.  The  same 


result  was  later  attained  by  E.  Reich  [23]  through  the  use  of  reversibility 


A related  derivation  was  demonstrated  by  F.  P.  Kelly  [17]  ; his  results  apply 


to  a large  class  of  Markovian  queueing  networks  to  be  described  in  the  sequel 
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Example  7.2:  Kelly's  networks  with  random  routings  (see  Kelly  [17]). 

In  this  queueing  model  we  have  J service  stations  with  infinite  waiting 

line  capacities  and  I types  of  customers.  Exogenous  customers  type  i,  1 £ i s 1, 

arrive  at  station  J,  1 S J s J,  according  to  independent  Poisson  processes  with 

respective  rates  Oj(i).  Each  station  j houses  an  exponential  server  with  rate 

jjCfj(nj),  where  n^  is  the  total  number  of  customers  at  station  j.  The  routing 

probabilities  p , (i)  depend  on  the  type  of  customer  routed.  In  addition,  the 
Jx 

i-th  customer  in  line  J is  allocated  a proportion  fj(4,  n^ ) of  the  service 
effort  in  station  J.  A customer  arriving  at  station  j is  inserted  in  the  4-th 
position  there  with  probability  g^(4,  n^  + 1).  All  arrival,  service  and  routing 
processes  are  mutually  independent.  The  vector- va lued  process  of  line  configura- 
tions is  a Markov  process  with  state  space  F “ [(y^>  ...,  Yj):  c^  € I*]  where  I* 
is  the  set  of  all  finite  strings  Yj(1)\j(2)  ...  Yj(nj)  where  Yj  (4)  is  the  type 
of  the  4- th  customer  in  station  j (I*  includes  the  empty  string).  The  transition 
rates  of  the  state  process  are  defined  by 


q(v,  T a<<Y>)  ” Ojtfj  <nj>pj0<\j  (X))fj  U , Oj) 


q(y.  T.1j . 2 (y ) ) * nj  + !> 

q(v>  Tjkfm(v))  “ °jgj(nJ)pjk(YJ(£))fJU'  nJ)8k(m’  \ + X) 
where  T.  is  the  operator  that  removes  the  4-th  customer  at  station  j from  the 

J • K/  • 

network;  T*\  is  the  operator  that  inserts  a customer  of  type  i in  the  4-th 

• j • JL 

position  at  station  j;  is  the  operator  that  moves  the  4-th  customer  in 

station  j to  the  m-th  position  in  station  k. 

When  the  network  is  open  with  respect  to  every  customer  type  i,  1 s i s;  I , 
Eq.  (7.1)  has  unique  solutions  6j(l)  for  given  or  j “ orj(i)  and  p^  ■ p^(i)  , 

4 6j(i) 

1 £ ],k  s J,  and  we  denote  p,(i)  * — ^ . Under  certain  conditions  (see  [17], 

j 


. 
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Theorem  2)  the  equilibrium  distribution  has  the  form 

J 

c ' 


:t(vi V 2 b~^W 


(7.2) 


where  b is  a positive  constant  and 


vv  M 


f-rf  ?Aiu)) 
A *ja) 


if  iij  2 1 


otherwise 


Let  f-Kjj(c))t2a  be  the  equilibrium  traffic  process  of  customers  type  i 

which  depart  the  network  from  station  j.  Thus, 

. (T1  (v),  v):  V € T,  1 £ i £ n + 1)  and  9 (-,  y)  = [T1  Ay):  1 £ l £ n +1}. 

• j • i J ■‘■j  • j • a j 

For  any  v “ (v ^ » • ...  Vj)  € T we  now  compute  using  the  identity 
i ?1(i) 


' j 


ij 


V1 

(t,  y)  a t c (T1.  (y))q(TL  (v)  , v) 
t .J.2  .J.£ 


")+1  0,(1)  , J 

£“1  J J 


T 


5 , (i) 


(V>  Jx  CjCPjCnj+l)  + 1)pj0<-i)f  j (i>  nj  + 


1) 


ct(v)6j(l)pj0(t),  1 s i * I,  1 £ J £ J. 


Again,  part  c)  of  Corollary  5.2  holds  for  L^  ■ (i)pjQ(i) , 1 £ i £ I, 

1 £ j £ J.  It  now  follows  from  Corollary  5.4  that  the  [K  (t)}  are  mutually 

i j 

independent  Poisson  processes  with  respective  rates  5^  (i)pj0(i) , in  agreement 


with  [17]  p.  553. 
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Example  7.3:  Kelly's  networks  with  fixed  routes  and  gamma-distributed  service 
(see  Kelly  [18 J) . 

This  model  is  a variation  on  the  basic  setup  of  J stations  and  I types  of 
customers,  where  we  conveniently  take  Cj=l,  1 S j S J,  For  Is  is  I, 
customers  type  i arrive  according  to  mutual  independent  Poisson  processes  with 
respective  rates  cr(i).  A customer  traces  a fixed  route  r(i,  1),  r(i,  2),  . .., 
r(i,  S(i))  of  S(i)  stages  through  the  network  and  then  exits.  At  node  r(i,  s) 
en  route,  a customer  requires  a gamma  distributed  (Erlang)  service  composed 
of  z(i,  s)  phases  of  mutually  independent  exponential  services  each  with  mean 
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Here  T is  the  operator  that  inserts  a customer  with  attribute  set  e as  above 

• J • X> 

(i.e.,  a customer  type  i in  his  last  stage  of  the  route  and  last  phase  in  service) 

0 

into  the  i-th  position  in  station  j.  Observing  that  c„ (T  , . (v))  “ 

C • J • Aj 

6 1 <i,S (i) ) 

Ct(v)  ' i'(n  +1)  WC  comPute» 

V1 

m (t,  v)  - I c (T*  ,(Y))q(Te.  (y),  y) 

U * J • * * J • * 

ni+1  6.(i,S(i» 

■ c<.M  Vj + 1)fj“'  nj + i> 


ct(v)6j(i,  S (i) ) , 1 s i s I,  1 s J s J. 


We  conclude  that  the  [K  (t))tag  are  mutually  independent  Poisson  processes 
with  respective  rates  5^(i,  S(i)),  in  agreement  with  [18]  p.  423. 


Analogous  results  can  be  similarly  obtained  for  the  class  of  Kelly's  net- 
works in  Sec.  3 of  [18]  where  the  fj  are  allowed  to  differ  from  the  gj , but 
the  service  requirements  are  constrained  to  be  exponential. 

Suppose  the  rate  of  type  i arrivals  is  er(i»  y) 5 i.e.,  it  is  also  a function 
of  the  instantaneous  state  of  the  system.  Kelly  ([18],  Sec.  5)  considers  the 

case  or(i,  v)  ” or ( i)  • jr  i)i(N(y,  W)),  where  f:  N U r0]  4 [0,  «)  is  a given 

W€21:i€W 

function,  and  N(y,  W)  ^ Sn(v,  i)  where  N(y,  i)  is  the  number  of  type  i customers 

i-l 

in  network  configuration  y . He  shows  that  under  certain  conditions  the  equili- 
brium state  distribution  has  the  form 


c (y)  ■ b • B (v ) • I I A (y  ) 
jml  J J 


where 


M(y.W)-1 

b(y)  * TTt  IT  t(*0 

W€2  n-0 
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and  the  A^(vj)  are  still  defined  by  (7.3).  Thus,  in  the  notation  of  Example 

7.3,  B(Te  (y))  - TT  w(N(y,  W))  for  any  e = (i,  S (i) , z(i,  S(i))),  whence 
W:i  & 


c 


t 


(y)) 


c.  (y)-(  TT  t(N(v.  W))). 

W:i€W 


6,(1, S(i)) 
C5j  (n.,+1) 


It  follows  in  an  analogous  calculation  that 


m..(t,  y)  * c (v)6,(i,  S (i) ) • ] j \ii  (N  (>• , W)) 

J W:i€W 


Hence,  fC(t)}fc  and  ;K. .(t)}  are  pointwise  independent  iff  ]!  \|'(N(y,  W))  » L’ 

‘ J W:i€W 

independent  of  y £ T,  which  is  generally  not  the  case.  (Notice,  however,  that  when 

the  product  above  does  depend  on  y € F,  this  does  not,  in  general,  exclude  [K.  (t)] 

i j 1 3sa 

. + 
from  being  a Poisson  process,  albeit  pointwise  dependent  on  the  state.  ) A similar 

phenomenon  takes  place  in  Jackson  [16]  and  in  the  following. 


Example  7.4:  The  BCMP  queueing  networks  (see  Baskett  et  al.  [2]). 

These  networks  consist  of  four  types  of  stations,  all  related  to  Kelly's 
networks  in  [17],  There  are,  however,  three  differences:  customers  arrive 
according  to  state  dependent  Poisson  processes;  they  require  type  dependent 
services  which  are  mixtures  of  sums  of  exponentials;  and,  on  service  completion, 
customers  are  allowed  to  change  types  in  a Markovian  manner. 

Based  on  the  equilibrium  state  distributions  derived  in  [2],  it  can  be 
rigorously  shown  that  the  m^tt)  factor  into  ct(y)  and  another  product.  The 
latter  contains  the  instantaneous  arrival  rate  as  a state  dependent  factor. 
Consequently,  the  [K, . (t)V  and  {C(t)}  are  not,  in  general,  pointwise 

jL  J ■*  Lia  * 


f 

A trivial  case  in  point  is  an  arrival  process  to  a Jackson  network  which  is 
Poisson  by  definition.  However,  it  can  be  easily  verified  that  it  is  pointwise 
dependent  on  the  state,  say  in  equilibriur 


J 


-29- 


independent  when  the  network  is  in  equilibrium.  However,  it  can  be  rigorously 
checked  that  the  above  are  pointwise  independent  provided  the  arrival  rates 
are  fixed.  The  latter  fact  agrees  with  Theorem  13  in  [13]. 

The  author  is  unaware  of  any  result  in  the  queueing-theoretic  literature 
enunciating  Poisson  traffic  (over  a discrete  state  Markov  process)that  cannot 
be  explained  by  means  of  pointwise  independence  of  traffic  count  and  state. 


8 . Discussion 

The  class  of  intuitive  traffic  processes  that  can  be  modeled  via  distin- 
guished state  transitions  in  an  underlying  Markov  process  [C(t)l  is  reasonably 
comprehensive  vis-a-vis  applications.  In  particular  it  includes  all  traffic 
processes  in  the  queueing-theoretic  literature  with  the  exception  of  certain 
feedback  traffic  processes. 

Consider  a feedback  stream  of  customers  that  after  service  completion  in 

station  j immediately  rejoin  the  waiting  line  of  that  station  in  such  a way  that 

the  state  of  the  system  remains  unchanged  (notice  that  this  situation  never 

arises  for  traffic  processes  between  distinct  nodes  or  for  traffic  streams  that 

leave  the  network  altogether).  In  this  case,  defining  the  relevant  f T „ 

n n*u 

becomes  impossible  since  a consideration  of  any  traffic  set  9 is  insufficient  to 
determine  the  epoches  in  question.  Moreover,  a direct  appeal  to  Lemma  2.1  is 

now  invalid,  even  though  the  result  of  the  lemma  may  be  correct. 
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To  remedy  this  situation  one  may  attempt  to  proceed  in  two  ways.  First, 
it  may  be  possible  to  modify  fC(t)V„  into  a new  Markov  process  ^(t)]  with 
state  space  T for  which  all  feedback  epochs  correspond  to  discernible  state 
transitions.  This  technique  was  used  by  Kelly  ([19],  Sec.  2.1),  and  earlier  by 
Daley  ( [ 10  j , p.  399)  to  treat  balking  arrivals  to  an  M/M/s  queue.  The  second 
approach  is  to  define  directly  the  requisite  joint  process  [(C(t),  K( t))V  and 
to  show  it  to  be  Markovian  by  another  technique  (e.g.,  via  a stochastic  integral 
representation  as  in  [3]  and  [20]).  Either  way,  chances  are  that  the  rest  of 
the  theory  in  this  paper  would  still  be  applicable,  as  was  the  case  in  [20]  and  [21]. 
A broader  class  of  traffic  processes  over  Markovian  processes  [C(t)}  may 

£23 

CO 

be  defined  by  allowing  the  traffic  epochs  fT  1 _0  to  be  affected  by  past  history 

n 'n-u 

of  rc(t)}  • 0tie  may  then  attempt  to  redefine  a Markovian  "state"  process 

rc(t)3  with  a new  T and  3 such  that  {£f(t)}  "remembers  by  state"  the  relevant 
*■  ' tza  taa 

information  in  the  past  history  of  the  old  [C(t)}tsa. 

The  approach  and  definitions  of  this  paper  shed  a new  light  on  the  differ- 
ential equations  (2.1).  The  traditional  heuristic  interpretation  is  that  the 
"probability  rate  of  being  in  state  y"  is  the  difference  between  the  "flow  rate 
into  v"  and  "the  flow  rate  out  of  y."  On  the  other  hand,  let  us  define 

9 * [(?,  v):  § € T - Cv} J and  © * C Cv » D : ? © T - [v3}- 

vin  Yout 

Then  clearly  for  any  y € T,  £ (y)  * m (t)  - m (t) , or  equivalently  upon 

3t  * Yin  Yout 

integration  c (y)  » c (y)  + ElK  (t)  - K (t)],  t a a. 
c Yin  Yout 

From  this  equation  it  can  be  easily  shown  that  for  any  s £ t 

ct  (y)  - c (y ) - E [K  (s,  t)  - K (s , t)  ] 
s vin  Yout 

where  K(s,  t)  ^ K(t)  - K(s).  Thus,  from  a traffic  oriented  vantage  point,  the 
probability  difference  of  being  in  state  y at  the  extreme  points  of  any  time 
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interval  [s,  t]  equals  the  expected  difference  of  the  number  of  times  the 
system  entered  and  left  state  y in  the  aforesaid  interval. 

It  is  interesting  to  note  how  the  Markov  property  of  the  underlying 
"C (t) ] affects  the  feasibility  of  (K(t)}  being  a Poisson  related  process. 

It  turns  out  that  various  notions  of  independence  play  a significant  role  in 

this  respect:  independent  increments  in  (K(t)}  already  ensure  it  to  be  a Poisson 

oo 

process  (theorem  3.1);  a renewal  and  a time  invariant  m(t)  already  ensure 

the  same  thing  (Theorem  3.2);  weak  pointwise  independence  already  ensures  that 
disjoint  K^(t),  ...,  K^(t),  t 2 a,  are  distributed  as  mutually  independent 
Poissons  (Theorem  5.1);  and  finally,  pointwise  independence  already  ensures  that 
disjoint  {K-.(t)}  , ...,  [K.(t)}  are  mutually  independent  Poisson  processes 

(Theorem  5 .3) . 

A number  of  concepts  essentially  equivalent  to  pointwise  independence  have 
been  discussed  in  the  literature.  Muntz  [22]  discusses  departure  processes  from 
an  equilibrium  queueing  system  with  different  types  of  customers  whose  arrival 
rates  are  X^,  1 £ i £ I.  Suppose  each  customer  type  arrives  according  to 
independent  Poisson  processes  such  that 


v t r 


*i€S . 


ct  (r|)q(n,v) 
ct(\) 


where  is  the  traffic  set  of  the  respective  departure  process.  Muntz  calls 
this  condition  the  M =»  M (Markov  implies  Markov)  property  to  indicate  that 
each  such  departure  process  is  Poisson  when  the  arrival  process  is.  The  above 
condition  is  a special  case  of  Eq.  (5.5);  it  is  easily  seen  to  be  equivalent 
to  pointwise  independence  in  equilibrium. 

In  Sec.  5 of  [13],  Gelenbe  and  Muntz  discuss  Markovian  queues  with  Poisson 
arrivals  at  a fixed  rate  X;  they  define  such  systems  to  be  complete  (ibid,  p.  52) 


i 


-32- 


if  the  departure  process  [K(t);  satisfies 

C2cl 

>.At  + o(At),  if  n * 1 

0 (At) , if  n 2 1 

1 - \At  + o(At),  if  n ■ 0 

for  any  y € F. 

Then,  they  proceed  to  give  a heuristic  derivation  of  equilibrium  analogues 
of  Corollary  5.2.  By  virture  of  Lenina  5.1,  we  can  recognize  completeness  as 
pointwise  independence  of  ^C(t)}  and  fK(t)V_  when  the  former  is  in  equili- 

LaSfl 

brium. 

In  Sec.  6 of  [18],  Kelly  describes  a queueing  network  with  Poisson  arrivals; 
the  network  is  represented  by  a Markov  state  process  [C(t)3  in  equilibrium, 
and  each  departing  customer  is  classified  into  one  of  I groups  depending  (perhaps 
stochastically)  on  the  network's  past  history.  Such  a queue  is  quasi- reversible 
if  (see  p.  428  ibid.) : 

a)  departures  of  group  i customers,  for  i “ 1,  2,  ...,  I,  form  independent 
Poisson  processes;  and 

b)  the  state  of  the  network  at  time  t is  independent  of  departures  from  the 
network  up  until  time  t. 

Suppose  the  I departure  streams  can  be  modeled  by  traffic  processes 
[K^(t)}taa,  [Kj(t)}taa  via  traffic  sets  0^,  1 S i s I.  Then  quasi- 

reversibility clearly  implies  pointwise  independence  of  rC(t)}t2a  and  the 
rK. (t) } , 1 s i s I,  (Condition  b)  above).  However,  Theorem  5.3  shows 

that  pointwise  independence  of  [C(t))caa  and  the  [K^t)^^,  1 s i s I,  already 
implies  Condition  a)  above  (i.e.,  b)  implies  a)).  It  follows  that  for  the 
class  of  departure  processes  defined  as  traffic  processes  in  the  sense  of  this 
paper,  quasi-reversibility  is  logically  equivalent  to  pointwise  independence 
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(i.e.,  to  Condiclon  b)  alone). 

As  a matter  of  fact,  for  the  class  of  traffic  processes  in  this  paper  over 
an  underlying  >'C(t)]  in  equilibrium,  Kelly's  quasi-reversibility,  Muntz's 

w 

M = M property,  Gelenbe  and  Muntz's  completeness  and  our  concept  of  pointwise 
independence,  all  boil  down  to  essentially  the  same  thing.  Although  all  four 
concepts  are  largely  equivalent,  the  pointwise  independence  formulation  enjoys 
the  generality  and  convenience  of  being  stated  in  purely  probabilistic  terms 
without  any  allusion  to  queueing-theoretic  context  or  an  underlying  equilibrium 
assumption . 

The  utility  of  the  pointwise  independence  concept  is  greatly  enhanced  by 

Corollary  5.2  and  5.4.  The  former  provides  a convenient  computational  test 

for  pointwise  independence  which,  in  view  of  the  latter,  serves  as  a sufficient 

condition  for  mutually  independent  Poisson  processes;  its  ease  of  application 

has  been  demonstrated  in  the  examples  of  Sec.  7. 

The  utility  of  the  weak  pointwise  independence  concept  derives  from 

Theorem  5.1  and,  in  equilibrium  situations,  from  Corollary  5.1.  These  may 

serve  as  necessity  conditions  for  Poisson  traffic  processes  by  checking  the 

a 

actual  behavior  of  lim  ^P  (v , n)  against  the  hypothesized  one.  This  approach 
t-»a+  dt  c 

was  demonstrated  in  Sec.  6;  a more  substantive  application  of  this  strategy 
can  be  found  in  [21]  concerning  traffic  processes  on  the  so-called  nonexit  arcs 
of  a Jackson  network. 

The  concept  of  pointwise  independence  (of  traffic  and  state)  has  considerable 
relevance  to  the  study  of  queueing  network  decomposition.  A typical  Markovian 
queueing  network  is  postulated  to  have  Poisson  arrivals,  independent  servers 
and  independent  routing  switches — the  above  being  mutually  independent  processes. 
The  problem  of  valid  decompositions  arises  when  one  wishes  to  study  one  or  more 
subnetworks  in  isolation  via  the  theory  available  for  the  original  network.  In 
other  words,  under  what  conditions  does  a subnetwork  satisfy  all  the  postulates 


' 
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of  the  original  network?  In  the  aforementioned  typical  queueing  network  it  is 
required  that  all  incoming  streams  into  subnetwork  nodes  be  mutually  independent 
Poisson  processes  which,  in  addition,  are  also  independent  of  the  service  and 
routing  mechanisms  operating  within  that  subnetwork. 

Now,  certain  subnetworks  may  have  a state  process  (an  appropriately  selected 
subvector  of  the  original  vector  valued  state  process),  vhich  still  retains  the 
Markov  property.  Consider  the  departure  streams  from  such  a subnetwork.  As  we 
have  seen  in  the  examples  of  Sec.  7,  these  departure  streams  and  the  compressed 
state  are  quite  likely  to  be  pointwise  independent,  in  equilibrium.  Consequently, 
if  there  is  a subnetwork  whose  incoming  customer  streams  are  either  exogenous  or 
from  the  subnetwork's  complement,  that  subnetwork  will  indeed  satisfy  all  postu- 
lates of  the  original  network,  thus  constituting  an  equilibrium  original  network 
in  miniature.  The  reader  is  referred  to  [4]  for  an  example  of  this  situation 
from  the  domain  of  Jackson  queueing  networks. 

Finally,  we  point  out  the  plausibility  of  extending  the  results  of  this 
paper  to  traffic  processes  over  Markov  processes  with  time  dependent  transition 
rates  or  with  continuous  parameter  and  uncountably  infinite  state  space.  The 
latter  could  enable  one  to  treat  queues  and  queueing  networks  with  more  general 
arrivals  and  services,  such  as  the  limiting  cases  considered  by  Kelly  [18]  and 
Barbour  [1]. 
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